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We prove asymptotic normality of the so-called maximum likeli- 
hood estimator of the extreme value index. 

Oh | 1. Introduction. Let X\ , X2 , ... be independent and identically distributed 

• (i.i.d.) random variables (r.v.'s) from some unknown distribution function 

(d.f.) F. Denote the upper endpoint of F by x* , where x* = sup{x:F(x) < 
1} < 00, and let 



(1) F t (x) = P(X<t + x\X>t) = F{t +% { * {t) , 

with 1 — F(t) > 0, t < x* and x > 0, be the conditional d.f. of X — t given 
■ X > t. Then it is well known [see Balkema and de Haan (1974) and Pickands 

(1975)] that up to scale and location transformations the generalized Pareto 
I d.f. given by 

^| (2) H 1 {x) = l-{l+ 1 x)- 1 /\ 

£3. x>0if7>0 and < x < — 1/7 if 7 < [for 7 = read (1 + 72;) -1 / 7 as 

exp(— x)], can provide a good approximation to the conditional probabili- 
ties (1). More precisely, it has been proved that there exists a normalizing 
function a(t) > 0, such that 



X 



lira F t (xa(t)) ^ H 7 (x) 
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for all x, or equivalently 

(3) lim sup \F t (x)-H 7 (x/a(t))\=0, 

t^ x * 0<x<x*-t 

if and only if F is in the maximum domain of attraction of the correspond- 
ing extreme value d.f. G 1 {x) = exp(— (1 + jx)~ 1 ^) [Gnedenko (1943)], com- 
monly denoted by F € D(G 7 ). The parameter 7 £ ]R is the extreme value 
index and is the same in both and G 7 approximations. 

Under this set-up, it turns out that a major issue for estimating extreme 
events is the estimation of the extreme value index 7. A variety of proce- 
dures to estimate 7 are now available in the literature [e.g., Hill (1975), 
Dekkers, Einmahl and de Haan (1989) and Smith (1987)], although there 
are still open problems. Quite often the accuracy of these estimators relies 
heavily on the choice of some threshold, but it is not our aim here to address 
this type of optimality questions. 

Instead, in this paper we present a relatively simple direct proof of the 
asymptotic normality of the maximum likelihood estimators (m.l.e.'s) of 
7 and g. It is based on some recent approximations to the tail empirical 
quantile function established by Drees (1998). Proofs of the asymptotic nor- 
mality of the m.l.e.'s of 7 and a were given by Smith (1987), and also by 
Drees (1998) in the case 7 > 0. Nonetheless we consider some proofs not 
easily understandable. Moreover, some of the conditions used in the afore- 
mentioned papers are unnecessarily restrictive. 

For an i.i.d. sample of size n, let X\ )Tl < X<i^ n < • ■ • < X n ^ n be the ascending 
order statistics. In view of (3) we can expect that observations above some 
high threshold are approximately generalized Pareto. This motivates that 
inferences on 7 should be based on some set of high order statistics, say 
(X n -k,m x n-k+i,n,---,X ntn ), or, equivalently, on 

^0 — X n —] tni 

^1 -"n— k+l,n X n _ 

^fe = X n ^ n X n _ k^yn 

where in the asymptotic setting k = k n is an intermediate sequence, that is, 
k n — > 00 and k n /n — > as n — > 00. Since it is plausible that asymptotically 
the information contained in Yq is negligible as k n — > 00, we apply a condi- 
tional likelihood approach [see, e.g., Cox and Hinkley (1974), page 17] in that 
we consider the conditional distribution of the (Yi,...,Yfc) given Yq = i/q. 
According to Theorem 2.4.1 of Arnold, Balakrishnan and Nagaraja (1992), 
it equals the distribution of the order statistics (Y* k , . . . ,Y£ k ) of an i.i.d. 
sample (Y±, . . . ,Y£) with common distribution F yo defined by (1). Hence, 
in view of convergence (3), the conditional distribution of the (Yi,...,Yfc) 
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given Yq = yo can be approximated by the distribution of an ordered sam- 
ple of k i.i.d. generalized Pareto random variables with d.f. x i— > H ry {x/a). 
This suggests to estimate the unknown parameters 7 and a by a maxi- 
mum likelihood estimator in the approximating generalized Pareto model; 
that is, given the sample (x±, . . . , x n ) [or rather the largest observations 

x n ,n)], we maximize Hi=i h 7 ,a{yi) with 
1 < j < fc, and /i 7j(J (y) = dH 1 (y/a)/dy. 

Note that this approximative conditional likelihood function tends to 
00 if 7 < —1 and 7/cr J, — l/(x n>n — x n _f Cin ), and so a maximum over the 
full range of possible values for (7,0") does not exist. Since, moreover, the 
maximum likelihood estimator behaves irregularly if 7 < —1/2, we look for 
a maximum of the approximative likelihood function only in the region 

( 7 ,<t) e (-1/2, 00) x (0,00). 

The likelihood equations are then given in terms of the partial derivatives 

d\o ghl Ay)_ i. log f 1 + l y )_(i + 1 \ v/° 



dj 7 2 V c / \7 / 1 + (7/(7)2/' 

dlogh 7 , a (y) _ 1 (l +i \-( 1 /a 2 )y 



da a \7 /1 + (7/^)2/' 

where for 7 = these terms should be interpreted as 



d log h~Jy) 



dj 

d log ^ 7)CT (y) 



da 



= l(y\_y 

7 =o 2\o"/ ct' 

7=0 * & 



The resulting likelihood equations in terms of the excesses A" n _j +l n — X n ^ n 
are as follows: 

k 1 / 7 

M 7 / l + (7/^)(X n _ l+lin -X n _ fcjn ) ' 



it 

E 

t=i 



2. _|_ ]A (7/ tJ )(^«-»+l,n - X n - ktn ) _ ^ 
7 / 1 + {l/°){X n -i+l,n ~ X n - k ,n) 



(with a similar interpretation when 7 = 0), which for 7 7^ can be simplified 
to 

\ Yl lo § ( X + ^( X n-i+l,n ~ -^n-fc,n)J = 7, 

1 A 1 = 1 

k hi 1 + (7/^)(-Xn-t+l,n " *n-fc,n) ~ 7 + 1 ' 
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with (7, a) € (—1/2, 00) x (0, 00). The numerical problem to find a solution of 
these equations which maximizes the approximative likelihood was discussed 
by Grimshaw (1993). 

From the above reasoning it follows that the m.l.e. of 7 is shift and scale 
invariant, and the m.l.e. of a is shift invariant and scale equivariant. 

Next we sketch the proof of the asymptotic normality. Under standard 
second-order conditions [see (7)] we have for an intermediate sequence k n £ N 

(5) (Mlf^ll) 4^1 + h -^y n(t) 



a{k n /n) A e[ o,i] V 7o Ae[o,i]' 

where {Qn(t))te[o,i] is a distributionally equivalent version of the process 
(Xn-[k n t],n)te[o,i] , { Y n(t))te[o,i} is an asymptotically Gaussian process of known 
mean and covariance function (Lemma 3.1), 70 is the true parameter and o 
is a suitably chosen positive function [see (16)]. Hence for all t € [0,1] and 
all 7 and a, 

t7 ,,/ 1 + 7 Q„w-Q,(m =1 / ; . o ^ +t7 „7 1/2y 

V a a(k n /n) J \a J 70 a 

where a = a /a(k n /n). Now if the sequence of solutions (7, cr) satisfies 

7-70 = O P (&n 1/2 ) and a - 1 = O p (k^ 2 ), 
one can prove, using a construction similar to (5), that 

inf fi0 ( l + lQn(t)-Qn(l) 



l/(2fe„)<t<l V cr a(k n /n) 
is stochastically bounded away from zero (Lemma 3.2). This implies 



a a(k n /n) 
log ( 1 + ( I - 70) — + t»W*Y n ® 



(J / 70 cr 



7 \l-t^ , . 70 7 

- -70 r-t 70 - 

cr / 70 cr 



+ t 702 fc -l/2 yn(t)+Op(fc -l/ 2) 



and 



l + (7/a)(Q„(t)-Qn(l))/a(fc B /n) 

= (l - (I ~ 7o) ~ t^lk-^Y n {t) + o p {k-^)) , 

where the o p -term is uniform for l/(2fe n ) < t < 1 (proof of Proposition 3.1). 
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— 1/2 

Hence, up to a o p (k n )-term, (4) are equivalent to linear equations which 
can be solved readily. The proof in Case 70 = requires longer expansions 
but is similar. 

The precise statement about the asymptotic normality is given in Theo- 
rem 2.1. In Theorem 2.2 an equivalent explicit estimator is constructed in 
the case 70 = 0. 

Throughout the paper, F*~ denotes the generalized inverse of F, — ► con- 
vergence in distribution and — ► convergence in probability. 

2. Asymptotic normality of the maximum likelihood estimators. As- 
sume that there exist measurable, locally bounded functions a, $ : (0,1) — > 
(0, 00) and * : (0, 00) — > R such that 

(7) hm = tx) - F ^~ *))M*) ~ (£H ~ 11/^ - * (x ) 

for some 70 > —1/2, for all £ £ (0, 1) and x > 0, where a; 1— > \&(j;)/(x _70 — 1) 
is not constant, <J>(i) not changing sign eventually and $(t) — ► as t [ 0. 
Then, according to de Haan and Stadtmiiller (1996), [$| is —p- varying at 
for some p < 0, that is, lim^m &(tx)/&(t) = x~ p for all x > 0, and 

|-( x -(70+p)_ 1)/(70 + p); p<0) 

(8) *(s) = ^ -x-^log(x)/ 7o , 7o^P = 0, 

Uog 2 (x), 7o = p = 0, 

provided that the normalizing function a and the function $ are chosen 
suitably. Condition (7) is a second-order refinement of F E D(G 10 ). Still, it 
is a quite general condition, satisfied for all usual distributions satisfying the 
max-domain of attraction condition. 

We assume throughout that k n is an intermediate sequence, that is, k n — > 
00 and k n /n — ► as n — > 00. 

Theorem 2.1. Assume condition (7) for some 70 > —1/2 and that the 
intermediate sequence k n satisfies 

(9) <S>(k n /n) = 0{k- 1 / 2 ). 

Then the system of likelihood equations (4) has a sequence of solutions 
(7n 5 <5"n) that verifies 

no) - (j ^ k; 'H^) iy - ^ + ^wj* 



7o 

d (70 + 1^ 2 rl 



7o Jo 



(t^° - (2 7o + 1)^°)(W(1) - t-^ +1 ^W(t))dt, 
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jfcl/2f i 

n \a{k n /n) 

- ^±lk^(^-) /'((to + 1)(2 70 + 1)^ - dt 
To \n / Jo 

_d 70 + 1 /■ + + 270 _ ^ 0)(w(1) _ r (TD+l)^( t )) # 

7o Jo 

(11) 

as n — ► oo, and £/ie convergence holds jointly with the same standard Brow- 
nian motion W . For 70 = these equations should be interpreted as their 
limits when 70 — ► 0; that is, 



(12) 



(13) 



+ # 2 * £(2 + logt)^(t) dt 

4- ( 1 {2 + \ogt){W{l)-t- l W{t))dt, 
Jo 

^(^n- 1 ) - kl n /2 *(-) (\z+io g tm)dt 

\a(k n /n) J \nJJo 

4 / 1 (3 + logt)(W(l) -t^W^dt. 
Jo 



Moreover, any sequence of solutions (7^,0^) which is not of the type (10)- 
(13) must satisfy kj/ 2 ]^ — 7o|-^oo or k n ^ 2 \a n /a(k n /n) — l|-^>oo. 

Remark 2.1. Condition (9) is satisfied if k n — ► 00 not too fast. The bias 

term ( 7o + l) 2 k n /2 $(k n /n) - (2 7o + l)* 2 ™)* (t) cft/70 in (10) vanishes 

1/2 

if kn <&(k n /n) — ► 0. A similar remark applies to (11)— (13) . 

Remark 2.2. Note that the likelihood equations are satisfied with 7 = 
if and only if 

k /-, k \ 2 

X n — k.n) I 



27 y^(^n-i+l,n — -^n-fc,n) 2 = ( T ^(-^n-i+l.n 
i=l \ i=l 



and a = Ef=i(^n- 

i+i )n — X n -k n )/k. Hence, the m.l.e. for 7 will a.s. not be 
equal to if, for example, F possesses a density. 

Corollary 2.1. Under the conditions of Theorem 2.1 and if 

(14) k^(^-)^XeR, 



n 



the solutions (10) -(13) verify 
(15) fcV 2 



7n -70 

a n /a(k n /n) - 1 
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where N denotes the bivariate normal distribution, p, equals 



T 



if p<0, 

*/ 7o = P = 0, 



and 



1 - 2p + 7q - p7o 
.(l-p)(7o-p+l)'(l-p)(7o -/? + !) 

i,7 -T, 



(l + 7o ) 2 -(l + 7o) 
-(l + 7o ) 2 + 2 7o + 7o 



Remark 2.3. Smith (1987) examined a slightly different version of the 
m.l.e. that is based on the excesses over a deterministic threshold u = u n 
instead of the excesses over the random threshold X n -k n n . For the com- 
parison of Smith's results with Corollary 2.1, we focus on the case 70 / 0, 
p < and A = 0, when there is no asymptotic bias, since in the other cases 
the more restrictive second-order conditions used by Smith are not directly 
comparable to our setting. 

Let K denote the (random) number of exceedances over the threshold u 
and let 



0",, 



7o^, 

l7o|(i^(l) 



u 



7o >0, 
70 <0. 



Then it was shown that the standardized m.l.e. 's K l / 2 {^ n — , yo,^ n /a n — 1) 
based on the exceedances Xi — u converge to a centered bivariate normal 
distribution with covariance matrix 

(I + 70) 2 -(I + 70)' 
-(I + 70) 2(1 +70) 

At first glance, it seems peculiar that we obtain a different asymptotic vari- 
ance for the scale estimator in Corollary 2.1, namely 2(1 + 70) + 7o- However, 
the following heuristic reasoning shows that in fact the increase in the vari- 
ance is due to the slightly different standardization. 

To make the results about the asymptotic behavior comparable, in our 
setting one has to condition at the event X n _k n ,n = u - Then Smith's result 

— 1/2 

claims that conditionally a n = <r n (1 + fcn ' Z n ) for some asymptotically cen- 
tered normal r.v. Z n with asymptotic variance 2(1 + 70). Hence conditionally 

at X n _u„ _ n — u. 



kV 2 



Or, 



a(k n /n) 



1 



0~r> 



a(k n /n) 



kV 2 



0~ r , 



a(k n /n) 



1 



Because, in the restrictive setting considered here, a{k n /n) = Toi*"* - (1 — 
kn/n) for 70 > and a(k n /n) = |7 |(F^(1) - F<~(1 - k n /n)) for 7o < 0, 



<s 
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unconditionally (i.e., when u is replaced with X n _k„,n) cr n /a(k n /n) — > 1 
in probability, so that the first term tends to a normal random variable 
with variance 2(70 + 1). According to the approximation of the tail em- 
pirical quantile function [cf. (18)], unconditionally the second term con- 
verges to 7qW(1). Since asymptotically X n _k n ^ n and the excesses X n _i + \^ n — 
X n -k„,nA < i < k n , are independent, so are Z n and W(l). Hence the two 
variances 2(70 + 1) and 7q add up, leading to the variance given in Corollary 
2.1. 



We now show that if 70 = 0, the m.l.e.'s are asymptotically equivalent in 
some sense to explicit estimators. Define 

fcn i=l 

,0^2 



7* = l"o 1 



1 A (m^)' 



and 



k n \ 2(mi 1} ) 3 



(2) 



It can be shown, using Corollary 3.1, that these estimators are consistent 
and asymptotically normal if 7 < 1/2. Let (7mle, <5"mle) be a sequence of 
solutions of (4) as described in Theorem 2.1. 

Theorem 2.2. If F is in the class of distributions that satisfy (7) with 
70 = and if (9) holds, then 

kn 2 (% -7mle)-^0 

and 

k i/2 ( a*(k n /n) -q- M le \ _^ Q 
a(k n /n) J 



Remark 2.4. If, in addition, (7) holds with p < 0, sup{x\F(x) < 1} > 
and k n = o(log 2 n), then we have an analogous result for the moment 
estimator introduced by Dekkers, Einmahl and de Haan (1989): 

kl/ 2 (7mom — 7mle) 0, 

where 



7MOM 



2 v Ad 2 > 
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with M n 3) = ^Efeo 1 QagX n - itn - \ogX n _ kn , n )i, j = 1,2. A similar state- 
ment holds for the scale estimator 



K\ _ 2(M, 
n 



«) 3 



The condition k n = o(log 2 n) ensures that the bias vanishes asymptotically. 
We prove this remark in Section 3. 

3. Proofs. Given (7) with 70 > —1/2 and (9), from Theorem 2.1 in Drees 
(1998) one can find a probability space and define on that space a Brownian 
motion W and a sequence of stochastic processes Q n such that (i) for each n, 

(Qn(t))te[o,i\ = (^n-[M,n)te[o,i]) and (") there exist functions a(k n /n) = 
a(k n /n)(l + o($(k n /n))) and &(k n /n) ~ <fr(k n /n) such that, for all e > 0, 

Q n {t)-F^{l-k n /n) 



sup t^ +1 l 2+£ 
te[o,i] 



a(k n /n) 



(16) _(*^_ r (T«>EM + 4('*iW*) 

V 7o fen V n J 

= o p (k~ 1 ^ 2 ) + o p f$ ^— asra^oo. 

A similar expansion is also valid for 70 < —1/2 when F*~(l — k n /n) is re- 
placed with a suitable random variable. 
Define 

n(Qn{t)-Q n {i) t-^-r 



(17) y B (t) = 



a(k n /n) 70 

[read (i _7 ° — l)/7o as — logt, when 70 = 0]. Hence we have the following 
lemma. 

Lemma 3.1. Suppose (7) ZioZds and that the intermediate sequence k n 
satisfies (9). Then, for all e > 0, 

(18) y n (t) =iy n (l)-t-(70+l) Wn (t) +A ;y2$^^ (t)+Op(1)t -(70+l/2 +£ ) 

— 1 /2 

w/iere W„(t) = kn ' W{k n t) is a standard Brownian motion and 
the o p -term is uniform for t € [0, 1] . 

From this lemma the following corollary follows easily. 

Corollary 3.1. Under the conditions of Lemma 3.1, for all e > 0, 

(19) Y n {t) = O p (l)t-^ +l ' 2+ ^ 

as n — ► oo, where the O p -term is uniform for t 6 [0, 1] . 
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Given the previous results, to prove Theorem 2.1 it is sufficient to consider 
the likelihood equations with (X n _[ knt ^ n — X n _ kn ^ n ) replaced by Q n (t) — 
Q n (l), t € [0, 1]. It is convenient to reparametrize the equations in terms of 
(7, <r) = ( r y,a/a(k ri /n)). Then we have the equations 



V7 



log 1 + 



(20) 



1 + 1 

7 

Vi 

- + 1 

V7 



7 Qn{t) ~ Q n (l) 

a a(k n /n) 
(l/a)(Qn{t) - Q n {l))/a(kn/n) 

1 + (7/or) (Q n (t) - Q n (l))/a(k n /n) 
{l/o){Qn{t)-Qn{l))ra{K/n) 

1 + {l/a){Q n {t) - Q n (l))/a{k n /n) 



dt = 0, 
dt = l. 



Lemma 3.2. Assume conditions (7) and (9). Let (7, a) = (7n,<5" n ) be 
such that 

(21) \ 7 /a- 7o \ = O p (k- 1 / 2 ). 
Then, if -1/2 < 70 < or 70 > 0, 

(22) P (i + l ^-QfK c n t-^,te\' 

\ a a{k n /n) [2k n 

for some r.v: ' s C n > such that 1/C n = Op(l). If Jo = 0, 



n —¥ 00, 



(23) 

and 
(24) 



a d[k n /n) 2 



1 



n — > 00, 



Qn(t)-Qn(l) nn , , 
SUP . r = O p (log k n ) 

te[o,i] a{k n /n) 



n — > 00. 



Proof. It suffices to prove the assertions with Q n (t) replaced with 
X„_[ fcnt ] n . Without loss of generality, one may assume Xi :Tl = F*~(l — f7i, n ) 

for uniform order statistics 17 i>n since pf n -[M>")*e[o,l] = (F*~(l - E/[fc„t]+i, n ))te[o,i] 

(Qn(*))te[0,l]- 

Note that, by Shorack and Wellner [(1986), Chapter 10, Section 3, page 
416, inequality 2], 



(25) sup 

l/(2fcft)<t<l 



[k n t]+l,n 

k n t 



Op(1), 



sup 



k n t 



O p (1) 



o<t<i nU[ knt ] + i tTl 

as n-> 00. Also note that (7) implies, for some functions 5(s) ~ a(s) and 
l>(s) ~ 3>(s), s i 0, for all x > and e > 0, 

- sx) - F^(l - s))/5(s) - (x-to - 1)/7q 



lim sup x 70+e 

s J.O CKaKzo 



$(x) 
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[Drees (1998), Lemma 2.1]. Combining these two results, we obtain 



sup t 70 
te[i/(2fe„),i] 



+e 



F*-(l-U [knt]+hn )-F^(l-k n /n) 



(26) 



a{k n /n) 
((n/k n )U [knt]+1>n )- 



-70 



7o 



X 



n r/ 



o p (l). 



Next use this approximation simultaneously for t £ [l/(2fc n ),l] and t=l. 
In view of the special construction X n _t knt ] n = F*~(l — Ui knt -\ + ^ n ), we then 
have, for —1/2 < 70 < or 70 > 0, 



X n -[k n t],n ~ X 



n—k„,n 



a(k n /n) 

_F^(l-U [knt]+hn ) 



F^(l-U kn+hn ) 



1 



n 



a(k n /n) 

-in 



7o \k n 1 J 



n 



( 1 Uk n +l,n 

7o \k n 



-70 



n 



Hence 



1 + 4 



7 -^"n-[fc„i],n — X. 



n—k n ,n 



a{k n /n) 
n 



U kn +l >n 



"70 



70 



1 



7o \k n 



-U kn +l,n 



"70 



7 1 



n 



+ ^7^V^ C/[M+1 ' n 



-70 



n 



'[k n t]+l,n 



= 1 + 11 + in + iv + v + VI. 

By (25), t 10 III is bounded away from zero uniformly for t G [(2k n )~ l , 1]. 
We will show that all the other terms tend to uniformly when multiplied 
with t~Q, so that assertion (22) follows with C n := mi te u 2kn -i-i ^1 t^°III — e n 
for a suitable sequence e n [ 0. 

By the asymptotic normality of intermediate order statistics, part I is 
O p (kn 1/2 ). Hence = o p (l), which is trivial if 70 > 0; for -1/2 < 70 < 
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note that t l0 k n 1 ^ 2 < 2~ l0 k n 10 1 ^ 2 — > as k n — > oo. By (25) and assumption 

— 1/2 

(21), part // is O p (k n ) so that by the same arguments as above, i 7o iT = 
0P (1). 

Next note that t~< ty(t) = o{t~ 1 / 2 ) as 1 1 0. This combined with (9) and 
(25) gives that and t~< V are o p (l). Finally, t 70 V7 = o p (l), provided 

one chooses e < 1/2. 

Now consider the case 70 = 0. Since (26) is still valid when 70 = 0, with 
the obvious changes, we get 

**n— [k n t],n ~ -^n—k„,n 

d(k n /n) 

f Tl \ f Tl 

= ~ log ( k~ U[knt]+1 ' n ) +log \k^ Ukn+1 ' n 



(27) 



+ o p [ t~ £ ^> 



t I "7. 

n 



Hence 



7 -^-n— [k n t],n -^-n—k„,n 

a a(k n /n) 

= 1 _ _i„ gt - ? iog^cr [M+I ,„J +-iog^o- fe , +1 ,„ 

Hence by (25) and assumptions (9) and (21), all the terms but the 1 in the 
last equality tend to in probability uniformly for t € [l/(2/c n ),l] so that 
(23) is obvious. 

Finally, to verify (24) just note that, for t = l/(2k n ), the expression (27) 
is of the order O p (logk n ), provided < e < 1/2. Since X n _iu t i n < X n>n for 
all t G [0, 1] the assertion (24) follows. □ 

Proposition 3.1. Assume conditions (7) and (9). Any solution (7, a) 
of (20) satisfying (21) and log a = Op(l) admits the approximation 

~ 7o) - (7 ° + 1)2 / V° " (270 + l)t 2 ^)Y n {t) dt = 0p (l), 



(28) , 1 J° 

v ; .t/o,_ 70 + 1 r, 



fc i/2 (5 . _ 1) _ / ((7o + i)(2 7o + 1)^70 _ t T«.)y n ( t ) dt = {i) 

7o Jo 
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as n — > oo. For 70 = these equations should be interpreted as their limits 
for 70 — > 0, that is, 



(29) 



k 1 n /2 j + f (2 + logt)Y n (t)dt = o p (l), 
Jo 

k l J 2 (a-l)- I (3 + \ogt)Y n (t)dt = o p (l). 
Jo 



Conversely, there exists a solution of (20) which satisfies (28), respectively 
(29), and hence also (21). 

Remark 3.1. For 70 7^ the condition on log a is not needed. 

Proof of Proposition 3.1. We consider the cases 70 > 0, -1/2 < 
70 < and 70 = separately. 

Case 70 > 0. In view of assumption (21), we may assume 7 7^ 0. Hence, 
system (20) can be simplified to 



(30) 



log 1 + - eft = 7, 

V cr a(k n /n) J 

1 , 1 

dt 



l + (j/a)(Q n (t)-Q n (l))/a{k n /n) 7 + 1' 



Next we will find expansions for the left-hand side of both equations. 
Rewrite the first one as 

\ a a(k n /n) J J(2k n )- 1 

(2fe„)-i V V cr a(k n /n) J J 

= h + 70 (l-O(k- 1 logk n )) + I 2 . 

First we prove that I\ is negligible. Since 1 1— ► Q n (t) is constant when 
t £ [0, (2k n )~ 1 ], Lemma 3.2 implies that, with probability tending to 1, 

( o U 1 , 7 QnW~Qn(l) _ 1 , 7 Qn(l/(2fc ra ))-Q n .(l) 

a a{k n /n) a a{k n /n) 

for all t £ [0, (2fc n ) -1 ] with C n stochastically bounded away from 0, so that 
-h < (2/cn)" 1 P (log k n ). On the other hand, from (17), (19) and (21), 

i + 1 Q n (l/{2k n ))-Q n {\) 



a a(k n /n) 

1 + (70 + o P (K^)) p^ 70 " 1 + Op(^' +£ )) = P (k^) 
V 7o / 
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— 1/2 

Hence, it follows that I\ = o p (k n )• 

Next we turn to the main term l<i- We will apply the inequality < 
x - log(l + x) < x 2 /(2(l A (1 + a;)), valid for all x > — 1, to 

x -t^(l^ Qnit) - Qn{1) ) 1 
(qo\ V cr d(k n /n) J 

Vcr / 7o cr 

Then, from Lemma 3.2 it follows that < 1/(1 A (1 + x)) < 1 Vl/C n = P (1) 
with probability tending to 1. Moreover, note that relation (19) implies 

t^Y n (t)dt = P U t~ 1 / 2 - £ dt)=O p ((2k n )- 1 / 2+£ ) = o p (l), 

for e S (0, 1/2). Hence from (17) and (19), as n — > oo, 

(2fc n )-i V V 0" a{k n /n) J J 

+0p (r WuM)-!)', 

\J(2k n )- 1 \ V cr a{k n /n) J J 

f ((i. ya y^ + i K ^Y nlt) ) d t 

7(2fc n )-i\\cr / 70 CT / 

\J(2k n )- 1 \\cr J 70 cr / 



((1-70)^+0,(^(2^)-)) 



+ I ^77 1/2 / * 70 ^n(i) <ft + o p (k~ 1/2 ) 
\cr Jo 

-\-O p (k n + k n (2k n ) 6 + k n (2k n ) / +£ ) 
= (^-7o)— ^7 + ^/2 f\^Y n {t)dt + o p {k- l l 2 ), 

\cr / 70 + 1 cr Jo 

where for the last equality we took e < 1/4. To sum up, we have proved that 
a a{k n /n) 



I - - 70 , 

,cr / 70 



i -t+^k i/2 r^Y n (t)dt+o P {k- 1 / 2 ). 

+ 1 cr Jq 



This means that the first equation of (30) is equivalent to 
7 = 7o + ( Z ~ 7o 



a J 70 + 1 
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+ 1^1/2 [ l t^Y n (t)dt + o p (K 1 / 2 ). 
o Jo 

Now we deal with the left-hand side of the second equation in (30). Ap- 
plying the equality 

1 x 2 

= 1-aH 

1 + x 1+x 

valid for x ^ —1, to x defined in (32), we get, for l/(2k n ) <t<l, 

1 



l + (j/a)(Q n (t)-Q n (l))/a(k n /n) 

'7 7 



t 70 



1- U-yo ^-t^lk-^Y n (t) 
\a J 7q a 

, (( 7 /ff - 7o)(l - t 70 )/7o + t^(n/5)1^ 1/2 Y n {t)) 2 



t7o(i + ( 7 /a){Q n (t) - Q n {l))/a{k n /n)) 
Hence the left-hand side of the second equation in (30) equals 

»(2fc„)- 1 l 

■dt 



1 + h/a)(Qn(t) - Q n (l))/a(k n /n) 

(33) + f (V° - f ? - 7o) - ?^ 2 ^y„(t)) dt 

J(2kn}- 1 \ \ a J 7o o- / 

/- 1 ((T/g - 7o)(l - ^°)ho + {l/a)kn 1/2 t^°Y n (t)) 2 
ypfcn)- 1 1 + (7/ff)(Qn(*) - Q»(l))/o(Wn) 

— 1 /2 

From (31) it follows easily that the first integral is o p (k n ). Direct cal- 
culations and (19) show that the second integral equals 

7o + l Vo" / (70 + 1) (270 + I) a Jo 

+ O p ((2fc n )-^" 1 + A;- 1 / 2 (2fc n )-^- 1 + k- 1 ' 2 {2k n )-^- 1 / 2 ^). 

— 1/2 

Here, for e < 1/2, the Op-term is o p (k n ). By Lemma 3.2, the last integral 
of (33) is bounded by 

O p ( I' £» ( (I - to) — + ZK^Y n (t)) 2 dt) 

= O^k- 1 + k~\l + (2fc n )-^ +2£ ) + fc- 1 (2A; n )- 70 - 1/2+e ) = o p (k-V 2 ), 
ife<l/4 + 7o/2. Therefore we have proved 

1 

■dt 



o l + {~f/a)(Q n (t)-Q n (l))/a(k n /n 
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'7 



70 + I \a 'V (70 + I) (270 + 1) 

- Ik- 1 ' 2 f 1 t 2 ^Y n {t) dt + o p {k~ 1 / 2 ). 
(J Jo 



Hence, under the given conditions, system (30) is equivalent to 
Jo + [Z- 70^ 



a ) 70 + 1 



(34) 



+ ^fc~ 1/2 / w n (t)dt + 0p (fc,: 
7 \ 1 

7o 



1/2 )=7, 



7o + l / (70 + 1) (270 + I) 

-Ik 1 ' 2 tt 2io Y n {t)dt+o p {k- x i 2 ) 



7+1 

Next we prove that (34) implies (28). First note that, in view of (19) and 
(21), (34) implies 

7o + - - 70 



a ) 70 + 1 



(35) 



+ 7o fc- 1/2 / t*>Y n (t) dt + opik- 1 ' 2 ) = 7, 



7 % 
- -7o 



70 + 1 \a 'V (7o + l) (270 + 1) 

-7o^ 1/2 ! t 2 ^Y n {t)dt + o p {k~ 1 ' 2 ) 



7 + 1 



The first equation and (21) show that (7 — 7o| = O p (k n 1 ' 2 ), hence (7 — 7o| 2 = 

o p (kn 1/2 ). Therefore l/( 7o + 1)- 1/(7 + 1) = (7 - 7o)/(7o + I) 2 + o(k~ 1/2 ) 
and so (35) implies 

(1 

7 - 7o - - - 70 



a J 70 + 1 
^n V2 7o / t^Y n (t) dt + o p (fc- 1/2 ) = 0, 







7-7o / 7 \ 1 



(70 + 1) 2 \a 7 V (70 + 1) (270 + 1) 



fc7 1/2 



7o 



f 1 t 2 ^Y n (t)dt + o p (k- 1 / 2 ) = 0. 
Jo 



Now straightforward calculations show that a solution of this linear system 
in 7 — 70 and 7/cj — 70 satisfies (28). 

Since conversely a solution of type (28) obviously satisfies the condition 
(21), it is easily seen that it also solves (34) and thus (20). 
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Case —1/2 < 70 < 0. Again, in this case system (20) simplifies to (30). 
Rewrite the left-hand side of the first equation as 

dt + 



a a(k n /n) 



log (t -70 ) dt 
dt 



V V o" a[k n /n) 

= Ji + (70 + 0{s n \ loga n |)) + J 2 

and choose s n = A;" 5 , with 5 G (1/2, (4e) _1 ) for some e G (0, 1/2). 

Now we prove that J\ is negligible. Note that since t 1— > Q n {t) is constant 
when £ € [0, (2fe n ) -1 ], (22) is trivially extended to t € [0, 1] when 70 < 0. By 
definition Q n (t) - Q n {l) > 0, for all t G [0, 1] and d{k n /n) > 0. Since by (21) 
P{7 < 0} — > 1, Lemma 3.2 implies 



P 



lo8|1 + 2 ^W-gf) 

o- a{k n /n) 



<|log(C n ,t- 70 )|,tG[0,l] 



1. 



as ra — > 00, so that J Sn | log(C n ,i l0 )\dt = Op(s n \\ogs n \) = o p {k n 1 ' 2 ) gives 
■h = o p (kn 1/2 ). 

Next we approximate Ji- Check that < x — log(l + x) < x 2 /[2(l A(l + x))] 
holds for all x > — 1. Hence, in view of (17) and Lemma 3.2, choosing 1 + x = 
+ {l/a){Q n {t) - Q n (l))/a(k n /n)], we obtain 



■h 



7o 



±l k -VH^ Yn {t))dt 
70 cr / 



+ 0, 



cr 



7o 



1 - 1 70 7 



70 



7 

- -7o 
a 



7o + l 



+ o P (fc; 



1/2-70+1- 



+ 



Ik 1 ' 2 £ t 10 Y n (t) dt + o p (k~ l/2 J S J r l l 2 ~ £ dt 



7 

- -7o 
a 



1 - ?*> 7 



+ +V /2 * 7 °^(i) 



70 cr 

and from the choice of s n , Corollary 3.1, (21) and 70 G (—1/2,0), it follows 

— 1/2 

that the O p -terms are o p {k n )• Hence we proved that 

- o_m\ 



log 1 + - 



cr d{k n /n) 



70 + 



7 



cr 



7o 



1 



+ 



70 + 1 cr 



Ik- 1 ' 2 [ t^Y^dt + Opik- 1 ' 2 ). 
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Now we turn to the second equation in (30). Use a similar decomposition 
as in the case 7 > of the left-hand side: 



1 



l + (~f/a){Q n (t)-Q n (l))/a{k n /n) 
1 



dt 



+ I l*» - (I - 7o) - U-^Y n (t)) dt 

f l (( 7 /a- 7o )(l-^)/ 7o + ( 7 /a)fc- 1/2 ^y rt (t)) 2 

1 + (j/a)(Q n (t) - Q n {l))/~a{k n /n) 
:K 1 +K 2 +K 3 , 



with s n = k~ s for some 5 G ((2 7o + 2) -1 , (4e - 2 7 o) _1 ) and e G (0, 7o + 1/2). 
Then by Lemma 3.2, K x = O p {s^ +1 ) = o p (kn 1/2 ). Moreover, 



7o + l \a 10 J (70 + l)(2 7o + 1) cr 

,/-) f s 70+l , 1.-V2 270+I , l-1/2 70+1/2-en 



^fc" 1 / 2 (\^Y n (t)dt 



— 1/2 

and, by the choice of 5, we have that the O p -term is o p {k n ). Finally from 
Lemma 3.2 and the definition of s n , 



K 3 = O p [ I t^ 



Z-7 ) — + ZK^Y n (t) 
cr J 7 o o" 



dt 



o p {k-\ s ^+ i v 1) + K x i$r* + 1) + ^ 1 («? b+1/2 - e + 1)) 

o P (K 1/2 ). 



Hence, the proof can be concluded by the same arguments as in Case 7 o > 0. 



Case 7 o = 0. In this case we use (20). Apply (twice) the equality 1/(1 + 
x) = 1 — x + x 2 /(l + x), the inequality \x — log(l + x) — x 2 /2 + x 3 /3| < 
x 4 /[4(l A(l + x) 4 )], valid for all x > -1, to x = (j/a)(Q n (t)-Q n (l))/a(k n /n), 
and use (23) in Lemma 3.2 to obtain for the left-hand side of the first equa- 
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tion 



7 Jo 



\ og ( 1 + lQn{t)-Qn{l) 



(36) 



a a(k n /n) 

(1 s (7/v)(Qn(t)-Qn(l))/~a(kn/n) 

[ + 1} 1 + ( 7 /5-)(Qn(t) - Q n (l))/a(fc„/n) 

1 lQn(t)-Q„(l) 



+ 



a 

1 a 



a(k n /n) 



■dt 



2 

1 /2 



. 1 (Qn{t)-Qn{l) 
^ + 7)^ 



a(k n /n) 



dt 



o 



7 / Qn(*)-Qn(l) 

~-3 v a(k n /n) 

n (t)-Q n (iy< 



er 



dt 



\<J 



a(k n /n) 



ll 
a 5 



Qn{t)-Qn(X) 



a(k n /n) 



dt 



By (17) the first integral in the right-hand side of the last equation equals 

- 1/2 Si Y n (t) ^ 
hand side of (36) consider 

1 



a 1 — a 1 k n 1/z J l Y n (t)dt + Op(k n 1/z )- For the second integral in the right- 



+ 7 



1 fQn(t)-Qn(l) 



CJ 2 



a{k n /n) 



dt 



+ 



?n(*)-Qn(l) 

a(k n /n) 



dt, 



with s n = k~ s , 5 G (1/2, (4c)" 1 ), e G (0, 1/2). Then the first of these last two 

— 1/2 

integrals is o p (k n ) by (24). In view of (17), (19) and | 7 /cr| = O p (k n 
the second integral equals 



-1/2, 



l + 2 7 



—k- 1 ' 2 

-o n 



(log^Yn^dt + Opik- 1 / 2 ). 

a* a* " Jo 

Using a similar reasoning but with 5 G (l/2,3(4e)~ 1 A 4(1 + 6e)~ 1 ), e G 
(0,1/2), the third integral of (36), equals -47<t" 3 + o p (kn 1/2 ). Finally the 

— 1/2 

Op-term of (36) is clearly o p (k n ) by (24). 
Hence we have that (36) equals 

47 



1 I + 27 



a- 



-h~ l l 2 [ Y n {t)dt-^k- l l 2 [\\ogt)Y n (t)dt + o p (k- l l 2 ). 
(J Jo <? Jo 

To deal with the left-hand side of the second equation of (20), use again 
the aforementioned equality for 1/(1 + re) and (23) in Lemma 3.2 to get 

" 1/r rQ n (t)-Q n (iy 2 



1 + 7 

7 



^ 1 Quit) - Q n {l) 



10 <? 



a(k n /n) 



dt 



a 



a(k n /n) 



dt 
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+ o p 



7 Qn(t) ~ Q n (l) 



(1 + 7) 



a a(k n /n) 

l + lk- 1 ' 2 ( l Y n {t)dt- f 
a a Jo Jo 



di 



lQn(t)-Qn(l) 



1 Jl Qn{t)-Qn(l) 

a a(k n /n) 



a a(k n /n) 



dt + O p (k n l (\ogk fl 



— 1/2 

where for the O p -term we used (24) and 7 = O p {k n ' ). Next we consider 
the second and third integral in the last equality, L\ and L2 say. As for L\, 
it follows from (24) that 



dt 



Li = O p (s n ~j(\ogk n ) 2 ) = o p (k 



p\ n n Ji 



if Sn = k~ s , 5 G (0, 1). As for L 2 , from (19) with e € (0, 1/2), we get 



L 2 = -2^ + O p {k^' 2 s- 2£ + k~ l ) = -2^ + o p {k~ l 



Hence, we proved that 



- + 1 



(rf/v)(Qn(t)-Q n (l))/a(kn/n) 



■dt 



lo V7 Jl + (l/v)(Qn(t)-Q n (l))/a(k n /n) 

= ^ - 5 + i*» 1/2 f y»(t) * + o P (^" 1/2 ). 

a a z a Jo 
Therefore, under the given conditions, a solution of (20) must satisfy 

(l-a)+Zy--l 
a 

-ak~ 1 ' 2 { l Y n (t)dt-k~ l l 2 [\\ogt)Y n (t)dt + o p (k~^ 2 ) = 0, 
Jo Jo 

(1 - Si) + 7 - ? + A;" 1 / 2 y n (t) + opfe 1 / 2 ) = 0. 
cr Jo 

—1/2 

Next note that the first equation implies a = 1 + O p (k n ), and so 7/cr 

— 1/2 

7 + o p (/c n ). Simplifying the above equations, we arrive at (29). 
The converse assertion is proved as in Case 70 > 0. □ 



Proof of Theorem 2.1. Recall that in the previous proofs we used 
the second order approximation (16). Because of d{k n /n) / a{k n /n) — 1 = 

— 1/2 

o(k n ), Proposition 3.1 shows that, under the conditions (7) and (9), any 

1/2 

solution (7^,0"*) of the likelihood equations such that k n [7^ — 70 1 and 
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k n \a^/a(k n /n) — 1| are stochastically bounded, must satisfy (28) and (29). 
Hence, in view of Lemma 3.1, &(k n /n) ~ &(k n /n) and 



a{k n /n) a(k n /n) a(k n /n) 

also (10)-(13) hold. 

Conversely, according to Proposition 3.1, there exists a solution of (20) 
satisfying (28) [resp. (29)]. This solution corresponds to a solution of the 
likelihood equations satisfying (10)-(13). □ 

Proof of Corollary 2.1. According to Theorem 2.1, the components 
of the left-hand side of (15) minus deterministic bias terms converge to cer- 
tain integrals of a Gaussian process, that is, to normal random variables. 
If kn 2 Q{k n /n) — > A, the bias term of Av/ 2 (7n — 70) tends to A((7o + l) 2 /7o) x 
Jo 1 ^ 70 - (270 + l)i 2 T°)*(i) dt. Using (8) the result follows by simple calcula- 
tions. Similarly, the asymptotic bias of the second component can be derived. 

To calculate the variance of the limiting normal random variable corre- 

spondingto ^ /2 (7n-7o),letX(t) = ((7o + l) 2 /7o)(t 70 -(27o + l)i 270 )(W / (l)- 
t~^ 0+1 ^W(t)). Then straightforward calculations show that var(/ 1 X(t) dt) = 
ft E[X(8)X(t))d8dt = (to + 1)*. 

1/2 1/2 

Likewise, to obtain the asymptotic covariance of k n ( A / n — To) with k n (cr n / 
a(k n /n) - 1), let Y(t) = (( 7o + l)/ 7 o)((7o + l)(27o + I)*' 70 - t^)(W(l) - 
t-<n+Vw(t)). Then cov(J l X(s)dsJ Q l Y(t)dt) = J, 1 J, 1 E[X(s)Y(t)]dsdt = 
— (1 + 7o). The limiting variance of the scale estimator is obtained similarly. 
□ 

Proof of Theorem 2.2. Integration of the various terms of (18) yields, 
for 70 = 0, 

/ C 1 ) 

/W m " 1 

n \~a{k n /n) 

= k ^([ l Q^)-QM) dt+ f\, dt 



Jo d(k n /n) 

= J\w n (l) - t~ l W n {t)) dt + k}/ 2 ® (^j jf 1 tf(t) dt + Op(l). 

Similarly, we obtain 

(2) 

k " 2 ( <-(?"/ ^2 - 2 )=- fziagtiWnM-t-iWnWdt 

\{a{k n /n)Y J Jo 

'k \ r l 



+ j fei/2$^W 2\o g m(t)dt + o P (i). 
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Now, using Taylor expansions, straightforward calculations give 

K /2 % = - A 2 + logt)(W„(l) - t- l W n (t))dt 
Jo 

+ k]! 2 ^ J\2 + logt)*(t) dt + o P (l), 

and hence by (12) 

kn 2 {% -7mle)^>0. 
The proof of the second statement is similar. □ 

Proof of Remark 2.4. Under the stated conditions the following ana- 
logue of (18) holds: 

,1/2 / lQgQn(*)-lQgQn(l) , 

n \~a{k n /n)/F^{l-k n /ny g 

= w n (i) - r l w n {t) - k'/H* + o p (i)rW-*, 

for some function <£* such that 

V 7 W F-(l-fc n /n) V n ; ' 

see Draisma, de Haan, Peng and Pereira [(1999), Appendix]. Now the re- 
sults by de Haan and Stadtmiiller (1996) imply that d(k n /n) tends to a 
positive constant, while F*~(l — k n /n) behaves like a multiple of \og{n/k n ). 
Hence the bias term is asymptotically negligible if k n = o(log 2 n), and the 
assertion can be concluded by the same reasoning as in the proof of Theorem 
2.2. □ 
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